| 1 | 1,166 | 2,136 | mechanize | The Mechanize library is used for automating interaction with websites.
Mechanize autom... |
| 2 | 5,624 | 5,401 | anemone | Anemone web-spider framework |
| 3 | 6,690 | 12,018 | link_thumbnailer | Ruby gem generating thumbnail images from a given URL. |
| 4 | 8,503 | 7,621 | spidr | Spidr is a versatile Ruby web spidering library that can spider a site, multiple domain... |
| 5 | 11,791 | 11,566 | wombat | Generic Web crawler with a DSL that parses structured data from web pages |
| 6 | 26,621 | 87,723 | upton | Don't re-write web scrapers every time. Upton gives you a scraper template that's easy ... |
| 7 | 65,204 | 19,007 | ronin-web-spider | ronin-web-spider is a collection of common web spidering routines using the spidr gem. |
| 8 | 74,574 | 87,723 | fake_useragent | Simple gem for generating valid web user agents. |
| 9 | 179,372 | 87,723 | seowebchecker-seoaudit-sdk | Instant website SEO auditing, on-page optimization diagnostics, meta tag validation, an... |